Economical Training Sets for Linear Id3 Learning
نویسنده
چکیده
Our work is in machine learning, a subfield of artificial intelligence. We describe a variant of the ID3 algorithm [5] which is attuned to the situation that every feature’s value-set is linearly ordered and finite. We then seek economical training sets, that is, ones which are small in size but result in learned decision trees of high accuracy. Our search focuses on geometric properties of the target concept, such as its extreme points, edges, faces, and surface. We categorize all concepts into three classes, from simplest to most general, and for each class we identify certain training sets, some quite small, others less so, which result in highly accurate learning of the concepts in that class. Some of our results are rigorously provable (but the proofs do not appear here), for other results our evidence is empirical.
منابع مشابه
A Flexible Link Radar Control Based on Type-2 Fuzzy Systems
An adaptive neuro fuzzy inference system based on interval Gaussian type-2 fuzzy sets in the antecedent part and Gaussian type-1 fuzzy sets as coefficients of linear combination of input variables in the consequent part is presented in this paper. The capability of the proposed method (we named ANFIS2) for function approximation and dynamical system identification is remarkable. The structure o...
متن کاملIncremental Induction of Decision Trees1
This article presents an incremental algorithm for inducing decision trees equivalent to those formed by Quinlan’s nonincremental ID3 algorithm, given the same training instances. The new algorithm, named ID5R, lets one apply the ID3 induction process to learning tasks in which training instances are presented serially. Although the basic tree-building algorithms differ only in how the decision...
متن کاملA Comparative Study ofID 3 and Backpropagationfor English Text - to -
The performance of the error backpropaga-tion (BP) and ID3 learning algorithms was compared on the task of mapping English text to phonemes and stresses. Under the distributed output code developed by Sejnowski and Rosenberg, it is shown that BP consistently out-performs ID3 on this task by several percentage points. Three hypotheses explaining this diierence were explored: (a) ID3 is overrttin...
متن کاملOn the Usefulness of Machine Learning Approach to Knowledge Acquisition
This paper presents results of experiments showing how machine learning methods are useful for rule induction in the process of knowledge acquisition for expert systems. Four machine learning methods were used: ID3, ID3 with dropping conditions, and two options of the system LERS: LEM1 and LEM2. Also, two knowledge acquisition options of LERS were used as well. All six methods were used for rul...
متن کاملImplementation of ID3 Algorithm
Inductive learning is the learning that is based on induction. In inductive learningDecision tree algorithms are very famous. For the appropriate classification of the objects with the given attributes inductive methods use these algorithms basically. These algorithms are very important in the classification of the objects. That is why many of these algorithms are used in the intelligent system...
متن کامل